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Abstract. The central physical concepts and mathematical techniques used in the 
theory of open quantum systems are reviewed. Particular emphasis is laid on the in- 
terrelations of apparently different approaches. Starting from the appropriate charac- 
terization of the quantum statistical ensembles naturally arising in the description of 
open quantum systems, the corresponding dynamical evolution equations are derived 
for the Markovian as well as for the non-Markovian case. 



1 Introduction 

Perfect isolation of quantum systems is not possible since any realistic system 
is influenced by the coupling to an environment, which typically has a large 
number of degrees of freedom. A prototypical physical system illustrating this 
situation is given by an atom interacting with the surrounding radiation field 

[!]■ 

In general, a complete microscopic description of the degrees of freedom of 
the environment is too complicated. Hence, one has to look for more simple 
descriptions of the dynamics of the open system. In principle, one should inves- 
tigate the unitary dynamics of the total system, i.e. system and environment, 
to obtain informations about the reduced system of interest by averaging the 
appropriate observables over the degrees of freedom of the environment. This is 
the main concern of the theory of open quantum systems [2] . 

Applications of the theory of open quantum systems are found in almost 
all areas of physics, ranging from quantum optics [3] to solid state physics [4], 
from chemical physics [5] to nanotcchnology [6], from quantum information [7] 
to spintronics [8]. On a more fundamental level, the theory of open quantum 
systems is relevant for quantum measurement theory [9] and for decoherence 
and the emergence of classicality [10]. 

Usually, the dynamics of an open quantum system is described in terms of 
the reduced density operator which is obtained from the density operator of 
the total system by tracing over the variables of the environment. In order to 
eliminate the degrees of freedom of the environment various approximations are 
needed which lead to a closed equation of motion for the density matrix of the 
open system. The most famous one being the Markov approximation which even- 
tually leads to a so-called quantum master equation which, in turn, generates 
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a quantum dynamical semi-group in the space of reduced density matrices [11]. 

Prominent rcprcscntants of such equations are the quantum optical master equa- 
tion, and, derived under slightly different assumptions, the quantum Brownian 
motion master equation, with applications in condensed matter physics. 

For stronger couplings between the system and the environment the finite 
relaxation time of the environment may significantly infiuence the dynamics of 
the open system, making necessary a non-Markovian treatment of the reduced 
system dynamics. Typical examples of such a behaviour arise in condensed mat- 
ter physics at low temperatures [4]. There are several strategies to go beyond a 
Markovian description of open quantum systems. Prominent approaches are pro- 
vided by the influence functional technique [4], the cumulant expansion [12-14] 
and projection operator techniques [15-17]. 

During the past decade another approach to the description of open quan- 
tum systems has emerged, essentially motivated by the experimental evidence 
for quantum jumps in simple three-level ions [18] and similarly in the photon ex- 
citation number of a single mode of a high-Q cavity [19]. The common feature of 
these experiments is that they can be described within the theory of continuous 
measurements [9]. Under the condition that the information extracted from the 
system by the environment is recoverable, alternative measurement schemes give 
rise to different stochastic processes for the wave function of the open system 
[20] . For example, the direct photon counting of the light emitted by an excited 
atom gives rise to a piecewise deterministic process for the wave function of the 
atom. On this selective level of description of open quantum systems the typical 
stochastic processes arising are Markovian. The relation between the selective 
wave function approach and the non-selective density matrix approach is simply 
stated [2]: The covariance of the stochastic wave function is the density matrix 
of the reduced system. 

The aim of the paper is to guide the reader in a systematic way through 
the diflferent levels of description available for the investigation of the dynamics 
of open quantum systems: Density matrix and wave function approaches, selec- 
tive and non-selective measurements, Markovian and non-Markovian approxima- 
tions, quantum optical and quantum Brownian motion master equations, linear 
and non-linear semigroups, piecewise deterministic and diffusive processes for 
the wave function. Particular emphasis will be laid on establishing relationships 
between apparently diff'erent approaches. For this reason the paper concentrates 
on the explanation of the flow diagram Fig. 1 which summarizes in a schematic 
and simplified way the main aspects of the theory of open quantum systems. 
The structure of the paper reflects the main paths through the flow diagram 
Fig. 1. In Sec. 2 we discuss the centre of the figure, i.e. the microscopic descrip- 
tion of the dynamics of open systems. In Sec. 3 we proceed anti-clockwise from 
the centre of the figure to the left, and show how dynamical maps and quantum 
Markov processes arise. In Sec. 4 we take the opposite path (clockwise from the 
centre to the right) and discuss quantum operations, continuous measurements 
and stochastic processes in Hilbert space. Finally, in Sec. 5 we describe the upper 
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2 Dynamics of open systems: Microscopic theory 

In general terms, an open quantum system is a quantum mechanical system 
S with Hilbert space Hs which is coupled to another quantum system B, the 
environment, with Hilbert space Hb- Thus, S' is a subsystem of the total system 
S + B living in the tensor product space 'Hs®'Hb- Sometimes, the surroundings 
B of the open system are termed reservoir to denote an environment with an 
infinite number of degrees of freedom. If the reservoir is in thermal equilibrium 
one speaks of a heat bath. 

Let us denote by Hs the Hamiltonian of the open system, by Hb the free 
Hamiltonian of the environment, and by Hj the Hamiltonian describing the 
interaction between the system and the environment. The Hamiltonian of the 
total system can then be written as 

H = Hs^lB+Is^He+aHi, (1) 

where 7s and Ib denote the identities in the Hilbert spaces of the system and 
of the environment, respectively, and a is a coupling constant. The dynamics of 
the coupled system S + B \s thus assumed to be Hamiltonian. 

An open system S is singled out by the fact that all observables A of interest 
refer to this system. Such observables arc of the form A® IB^ where A acts in 
the Hilbert space of the open system. If the state of the total system S + B \s 
described by some density matrix p, then the expectation value of the observable 
A is determined by 

{A) = trs{Aps}, (2) 

where 

PS = tVBp (3) 

is the reduced density matrix. In the above equations trg and tr^ denote, re- 
spectively, the partial traces over the degrees of freedom of the open system S 
and of the environment B. The reduced density matrix is of central interest for 
the theory of open quantum systems. As we mentioned, the total density matrix 
evolves unitarily and, hence, the time-development of the reduced density matrix 
may be represented in the form 

psit) = tiB {U{t,0)p{0)U\t,0)} , (4) 

where the initial state of the total system at time t = is given by p{0) and 
U{t, 0) is the time-evolution operator of the total system over the time interval 
from t = to t > 0. The corresponding differential form of the evolution is 
obtained from a partial trace over the environment of the von Neumann equation, 

^psit)=-itTB[H{t),p{t)]. (5) 

In the following we will survey the most important approaches and approxima- 
tions to the above exact equation of motion. To this end we will first describe 
the paths starting from the centre of the flow diagram Fig. 1 to the left and to 
the right through the lower part of the flgure. 
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Fig. 2. Schematic overview of tiie cases in wliicli a Marlcovian quantum master equation 
can be derived from an underlying microscopic theory. 



3 Dynamical maps and quantum Mcirkov processes 

Given that the initial state is of the form p(0) = psiO) ® Pb, the dynamics 
expressed through Eq. (4) can be viewed as a map of the state space of the 
reduced system which maps the initial state ps{0) to the state ps{t) at time 
t > 0, 

ps{0) ^ ps{t) = V{t)ps{0). (6) 

For a fixed t this map is known as dynamical map. Considered as a function of 

time t it provides a one-parameter family > 0} of dynamical maps. If 

the characteristic time scale over which the reservoir correlation functions decay 
are much smaller than the characteristic time scale of the system's relaxation, 
it is justified to neglect memory effects in the reduced system dynamics and one 
expects a Markovian type behaviour, which may be formalized by the semi-group 
property 

V{h)V{t2) = V{h+t2), h,t2>0. (7) 

The one-parameter family of dynamical maps then becomes a quantum dynami- 
cal semi-group. Introducing the corresponding generator £ one immediately ob- 
tains an equation of motion for the reduced density matrix of the open system 
of the form 

j^psit) = Cps{t). (8) 

Such an equation is called a Markovian quantum master equation. The most 

general form of the generator C is provided by a theorem due to Gorini, Kos- 
sakowski and Sudarshan [21] and by a theorem of Lindblad [22] according to 
which 



Cps = -i[H,ps] + (^AipsAl - ^^Aips - ^ps^Ia,^ . 



(9) 
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Fig. 3. A comparison of tlie typical time scales arising in the microscopic derivations of 
the quantum optical and the quantum Brownian motion limit of the quantum master 
equation, tb denotes the correlation time of the environment, tr the relaxation time 
of the open system, and ts the time scale of its systematic evolution. 



Here, H is the generator of the coherent part of the evolution (which need not be 
identical to the free Hamiltonian of the system) and the Ai are system operators 
with corresponding relaxation times 7^. Eq. (8) with this form of the generator 
is often referred to as Lindblad equation. In a number of physical situations a 
quantum master equation whose generator is exactly of the Lindblad form can be 
derived from the underlying microscopic theory under certain approximations. 
The most important cases are the weak-coupling limit, the singular coupling 
limit and the low density limit (see Fig. 2). 

A widely used Markovian quantum master equation that can be derived from 
a microscopic Hamiltonian for the total system in the weak-coupling limit is the 
quantum optical master equation [3]. The central assumption underlying the 
weak-coupling approximation is that the times scales of the system's relaxation 
Tji and of the correlation time of the environment tb are clearly separated, i.e. 
Tb ^ Tji. One further essential approximation entering the derivation of the 
quantum optical master equation is the so-called rotating wave approximation. 
The physical condition behind this approximation is the following one: The time 
scale Ts of the systematic evolution of the reduced system is small compared to 
its relaxation time r^, i.e. T5 ^ r^j. Unfortunately, this condition is violated in 
many physical applications involving stronger couplings and low temperatures. 
It occurs that the systematic dynamics of the reduced system may even by slow 
compared to the correlation time of the environment, that is tb <C ts- Such 
cases lead to the so-called quantum Brownian motion master equation [23] (see 
Fig. 3). 

In the treatment of open many-body systems one also encounters non-linear 
quantum master equations for the reduced one-particle density matrix [24]. In 
many cases the corresponding generator takes on the structure of a Lindblad 
generator whose coefficients depend parametrically on the density matrix. This 
means that the generator C = C[ps] provides a super-operator which represents 
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Fig. 4. Schematic overview of typical non-linear semi-groups. A typical example for a 
mean-field equation are the laser equations and an example for the application of the 
non-linear Schrodinger equation is super-radiance. 



a function of ps and which is of Lindblad form for each fixed argument. This 
immediately leads to a master equation of the general form 

f^psit) = C[ps{t)]ps{t). (10) 

Some prominent examples of non-linear quantum master equations are shown 
in Fig. 4. At this point we arrived at the lower left corner of Fig. 1. Now we go 
back to the centre of the figure and will explain why it might be necessary to 
follow the clockwise path from the centre to the right. 



4 Quantum operations, continuous measurements and 
stochastic processes in Hilbert space 

In order to extract information from a quantum system a measurement must 
be carried out. Let us consider the situation that an open system is measured 
through an indirect measurement on its environment. Thus, the open system is 
the quantum object to be measured, while the environment plays the role of the 
quantum probe. The latter is measured by means of a classical apparatus, once 
correlations between object and probe system are created as a result of their 
interaction. 

Let us assume that the interaction between the open system and the environ- 
ment begins at time t = 0. At this time the state of the system is characterized 
by the density matrix ps and the state of the environment, the quantum probe, 
is given by 

Pb =^Pk\4>k}{M- (11) 
k 
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The initial density matrix of the total system is thus p{0) = ps ® pB- time r 
a classical measurement apparatus measures the bath observable 

R = ^rm.\^rn){'Pm\-, (12) 
m 

the spectrum of which is assiimcd to be discrete and non-degenerate, for sim- 
plicity. The application of the von Neumann-Liiders projection postulate to the 
classical measuring device shows that the reduced system's state after the mea- 
surement is given by 

p'^ = P{m)-^<Pm{ps), (13) 

where 

^m(ps) = X] ^rnkPS^lnk^ (14) 
k 

with 

^mk = ^/Pk{^m\U\(t>k), (15) 

and 

P{m) = irs{$m{ps)}- (16) 

In these formulae U is the time- development operator of the total system de- 
scribing the coupled evolution of quantum system and quantum probe. The 
probability that the measurement outcome is rm is given by P{m). Under the 
condition that the outcome is Tm, the corresponding transformation of the re- 
duced system's density matrix from the initial state ps to the new state p'^ is 
provided by the map ^,n{ps) which is known as a quantum operation. Like the 
dynamical map (6) it represents a convex-linear and completely positive map. 
The representation (14) in terms of the operators ilmk takes on the general form 
required by the representation theorem of quantum operations [25] . 

When writing Eq. (13) it is assumed that the measurement is a sele(;tive 
one, i.e. that after the measurement the information on the measurement out- 
comes is retained. Therefore, the original ensemble described by ps is split into a 
number of sub-ensembles described by the various p^, each sub-ensemble being 
conditioned on a specific outcome rm- By contrast, in the case of a non-selective 
measurement the final state of the system after the measurement is given by 

p' = ^P(m)p;, = ^#„(p5), (17) 

m m 

which describes the ensemble obtained after re-mixing the sub-ensembles after 
the measurement. Thus, the first important step in the description of an open 
quantum system is to make clarity about the type of measurement which is 
performed in order to obtain information about the system. In other words, 
we have to know whether the (indirect) measurement is selective or not. The 
microscopic theory of the total (closed) system has to be supplemented with 
this information as is indicated in Fig. 1. This important distinction has fun- 
damental consequences on the choice of the formalism required to describe the 
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open system. In fact, selective and non-selective measurements require different 
characterizations of the quantum statistical properties of the open system. 

Let us now follow another important path through the flow diagram. Again 
we start at the centre of Fig. 1 and proceed clockwise to the right into the 
lower part of the diagram. The decisive aspect of this path is the indirect se- 
lective measurement of the open quantum system, which requires a particular 
characterization of the quantum statistical ensembles. 

A quantum statistical ensemble characterized in terms of a density matrix 
p describes a disordered set of a large number of individual quantum systems, 
where each system has been prepared in one of a certain set of states ijjof The 
preparation measurements could have been carried out, for example, through the 
measurements of complete sets of commuting observables. The various if) a, how- 
ever, need not be orthogonal. A mixture of these states with respective weights 
Wa gives rise to an ensemble £p which is described by the density matrix 

p = ^U;„|V'a)(V'a|- (18) 

A different kind of ensembles which is appropriate for the description of 
selective measurements and which will be denoted by £p is obtained as fol- 
lows. Consider a collection of pure quantum statistical ensembles £a describ- 
able by corresponding states Va- We want to keep, as required for a selective 
measurement, the information that a particular quantum system belongs to a 
particular ensemble Ea- For this purpose we take TVq identically prepared copies 
£■0'^ , Sa'^ 1 ■ ■ ■ , £0^"^ of £a for each a. The new ensemble £p is then the collection 
of these ensembles, that is an ensemble of ensembles: 

fp={f ff^^f ff^),...,fw,...,e<'),...}. (19) 

The numbers Na are chosen such that Wa = Na/N, where N = J2a which 
implies that £a appears with the statistical weight Wa in the set (19). The 
decisive distinction of an fp-ensemble to an f^-ensemble is that £p represents 
a set whose elements are again sets, namely the ensembles £a\ A schematic 
picture of an ensemble of type £p is given in Fig. 5. 

Since the various £„ making up are represented by their corresponding 
state vector ipa, an ensemble of the type £p gives rise to a probability distribution 
P = P[ip] on Hilbert space Hs- Consequently, the state vector becomes a random 
vector in Hilbert space (see [2] and references therein). More precisely speaking, 
the functional P[il>] represents a probability distribution on projective Hilbert 
space, that is on the space of rays in Hs- Regarded as a density fimctional on 
Hs, the distribution P[V'] is therefore subjected to the normalization condition 

j Dil)Dil)*P[,p] = 1, (20) 

with an appropriate volume element D^pD^p* in Hilbert space, it vanishes outside 
the unit sphere ||V'|| = 1 in Hilbert space, and it is invariant under changes of 
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many identically 
prepared systems 



a 



Fig. 5. Schematic representation of an ensemble of type £p. 



the phase of the state vector, that is P[exp(ix)'0] = PVIA- The density matrix 
p characterizing the corresponding ensemble £p now appears as the covariance 
matrix of the random state vector ip which is defined as the expectation value 
E of the quantity In terms of the probability density functional -P[V'] we 

have 



This relation clearly reveals that the statistics of an ensemble Ep is completely 
determined by the probability density P[V'], while the converse is obviously not 
true. 

The formalism of probability densities on Hilbert space now allows the de- 
scription of the dynamics of an open system which is continuously monitored 
through its environment (see the lower part of the flow diagram shown in Fig. 1). 
The probability density then becomes a time-dependent functional P = P[V',i] 
and the reduced system's state vector provides a stochastic process ip{t) in 
Hilbert space. Physically, ip{t) represents the state of the reduced system which 
is conditioned on a specific readout of the measurement carried out on the en- 
vironment. Consequently, the stochastic evolution depends on the measurement 
scheme used to monitor the environment. As an example we write a stochastic 
differential equation corresponding to the Lindblad equation (8) with generator 



A stochastic differential equation of this form is known as a piecewise determin- 
istic process. The first term on the right-hand side describes the deterministic 




(21) 



(9): 




(22) 
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Fig. 6. Different continuous measurement schemes give rise to different Markovian 
stochastic processes for the wave function of the reduced system. The stochastic 
Schrodingcr equations are obtained as diffusion limits of appropriate piecewise de- 
terministic processes. 



evolution periods given by the non-linear Schrodinger equation 



(23) 



The deterministic pieces of the motion are interrupted by instantaneous changes 
of the state vector according to — > These so-called quantum 

jumps are described by the second term on the right-hand side of Eq (22) which 
involves the random numbers dNi{t). These numbers take on the values or 1 
and represent independent Poisson increments with the expectation values 



E[dNi{t)]='yi\\Ai^{t)\\^dt. 



(24) 



A stochastic evolution equation of this form is obtained, for example, if the re- 
duced system represents an excited atom, the environment is an electromagnetic 
field vacuum and the system's state is monitored through the direct observation 
of the emitted quanta. 

Depending on the measurement scheme, it may be appropriate to perform a 
diffusion approximation of the above piecewise deterministic process. This leads 
to a diffusion process for the wave function of the reduced system involving 
real or complex Wiener noise. An overview of the Markov processes for the wave 
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function of the open system related to a certain continuous measurement scheme 
is given in Fig. 6. 

5 Non-Markovian processes 

Let us now turn our attention to the description of the non-Markovian dynam- 
ics of an open quantum system. We proceed counter clockwise as indicated in 
the upper half of the flow diagram shown in Fig. 1. Again, the starting point is 
provided by an underlying microscopic theory for the total system. Unlike in the 
Markovian case, the first step consists in deriving an exact equation of motion 
for the reduced density matrix of the open system through an elimination of the 
dynamical variables of the environment. Of course, a closed analytical expres- 
sion for the reduced density matrix can be obtained only for a few analytically 
solvable models, such as for the damped harmonic oscillator and for free Brow- 
nian motion [26 28]. In many interesting cases, however, exact representations 
for the reduced density matrix serve as starting points of a perturbation expan- 
sion in the system-environment coupling and of the development of numerical 
integration schemes. 

As indicated in Fig. 1 and in more detail in Fig. 7 there are several possi- 
bilities to carry out this program. Probably the most prominent one is to use 
the Nakajima-Zwanzig projection operator technique [15,16]. In this approach 
one derives a formally exact equation for the reduced density matrix of the open 
system in the form of an integro-differential equation involving a certain mem- 
ory kernel. The practical disadvantage of this approach is that the perturbation 
expansion of the memory kernel does not simplify the convolution structure of 
the equations whose numerical solution could be quite involved (see also [13]). 

As far as a numerical and/or perturbation approach is concerned a more ap- 
propriate strategy is to derive a time-local master equation for the open system's 
density matrix ps{t) which takes the form 

f^Ps{t)=IC{t)Ps{t). (25) 

IC{t) is a time-dependent generator, a super-operator in the reduced system's 
Hilbert space Hs- Employing the time-convolutionless (TCL) projection oper- 
ator technique [29,30] one can show that a master equation of the form (25) 
indeed exists for small and intermediate couplings in the case of factorizing ini- 
tial conditions. We remark that a similar method can also be used in the general 
case of a correlated initial state, in which case the time-local master equation 
contains an additional inhomogeneous term. It should be noted that Eq. (25) is 
local in time, i. e. that it does not involve an integration over the past history 
of the reduced system. Due to the explicit time-dependence of the TCL gener- 
ator lC{t), however, it does not lead to a quantum dynamical semigroup and, 
therefore, the generator need not be in Lindblad form. 

Eq. (25) provides an appropriate starting point for a perturbation expansion 
with respect to some coupling parameter a. To this end, one expands the time- 
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Fig. 7. Schematic overview of the difltoront approaches to the description of the non- 
Markovian dynamics of open quantum systems. 



local generator in powers of a, 

oo 

/C(i) = E""^"W' (26) 

n=l 

and solves the corresponding equation of motion which is obtained in the de- 
sired order in a either analytically or numerically. Such an expansion may be 
found in two different ways. One way is to start from the formal solution of the 
von Neumann equation of the total system and to use an expansion in terms 
of ordered cumulants [12-14]. Another way is to invoke the Feynman- Vernon 
influence functional representation of the reduced density matrix [26] and to ob- 
tain an expansion of the generator directly in terms of the influence phase. Both 
strategics, where applicable, yield identical expansions of the TCL generator 
[31]. The different approaches to the description of the non-Markovian dynamics 
of an open system are summarized in Fig. 7. 

In general, one expects that a time-local master equation whose generator 
consists of only the first few terms of the expansion provides a good description 
of the reduced dynamics for weak and moderate couplings. However, it should 
be emphasized that an expansion of the form (26) need not exist for strong cou- 
plings. What happens in these cases is that the initial state ps{0) is not uniquely 
determined by the state ps{t) at time t. Specific examples of the application of 
this technique to physical models and of the breakdown of the TCL expansion 
in the strong coupling regime are discussed in [2]. 

Within any given order the time-local master equation for the reduced density 
matrix ps{t) which results from the above procedure takes the following form, 

f^psit) = Ait)ps{t)+ps{t)B\t)+Y;^a{t)ps{t)Dl{t), (27) 

i 
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with some time-dependent linear operators A{t), B{t), Ci{t) and Di{t). This 
equation is linear in ps{t) and local in time, but it needs not be in Lindblad 
form. However, it is important to realize that a stochastic representation of the 
dynamics given by this equation is possible [32,2]. 

The key point for a stochastic unraveling of the non-Markovian master equa- 
tion (27) is the usage of a stochastic process in the doubled Hilbert space 
'Hs®'Hs- This means that we represent the dynamics through a pair of stochastic 
wave functions 

«(') = (^',?)). w 

such that 9{t) becomes a stochastic process in the doubled Hilbert space. An 
appropriate stochastic differential equation for a piecewise deterministic process 
in the doubled Hilbert space is the following, 

de{t) = -iG{e, t)dt + ^ JfflL J,(t)0(t) - 9{t)^ dN,{t). (29) 

The numbers dNi{t) = 0, 1 are again independent Poisson increments with ex- 
pectation values 

ndNM = ^f^^*' (30) 

and the non-linear operator G{6, t) is defined as 

G(^,*)=^(i^(0 + ^E^f^)^(*)' (31) 
with time-dependent operators of block structure, 

n')=(TB;,). (3.) 

With the help of the calculus of piecewise stochastic processes [2] it can now 
be demonstrated that the expectation value 

ps(i)=E[|</))(^|] (33) 

satisfies the non-Markovian master equation (27). Thus, any time-local master 

equation allows a stochastic unraveling in the doubled Hilbert space. This fact 
makes it possible to use the apparatus of stochastic processes in the analysis of 
non-Markovian quantum processes and to design the corresponding stochastic 
simulation algorithms. It also enables us to close, finally, the flow diagram shown 
in Fig. 1 through the path following the upper half of the diagram. 
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